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1 > 0 Introduction 

Regression ..„.lysi„ u often used In both the physical 
.n.1 social sciences. Howover. rejr.sslon analysts ls.„ost useful 
When the so-called Independent varlahl.s are truly Independent 1„ 
the sense that they .can he experimentally «„ip„ut.d. ' e.g.^an' 
• e,perl.en.ter can fl, the values o.f ,11 hut one Indipi'ndent varlahl.' 
. then vary the value of the rWlnlng v.rlahle, 'then cho.ose a se"c;nd 
.variable to manipulate., and ao forth. T-h. principles of experi-'' 
-ntal design show that for' a slven sample sl« ind as.aumlns. an 
-denying linear relationship the exp.rl.e'.ter should select . 

values of the Independent varl.hi.. <. ^ - ' ■ ■ 

cent variables to be fat .part -and uncor-rel.ted, 
resulting In unbiased estimates of the regression coeiflclent. thaf ' 
»o« precise ceteris paribus ^^t Ke sense tT at t.Mr stsnfa^ 

errors are sraalleat ri^ ^t.^^ ' . < ^ . 

"lest. In this case, the squared multiple correlation- 

Is simply the sum of the squares of th. '' ^ 

quares ot the simple correlations between 

the Independent and dependent variables. " ' ' 

I" survey research, random samples of parson, are selected 
from a de«ned population.. Most variables cannot be Independently 
manipulated as m a designed experiment, although ' stratified 
sampling may avoid mtercorrelatton >among some regressors. It 

very dlffldilt to stratify on .any vn'rlables.'' Unbiased estlmales. 



of 'par.aineter8 can be computed from such samples, but the precision 
of the estimates Is lessened by correlations among regressor 
variables-. Furthermore, the regressor varlab-les do not contribute 
independently- to " the sg^ared muUlple correlation, for- the squared 
multiple cvorrelatlon may be eltl^er 1-arger or smaller -than the sum 
of. the squared simple correlations. Regression analysis may ' 
•become more a tool for measuring correlation- or predictive power ' 
than for estimating parameters of a causal system. ' ' 

■ * Commonality, analysis is an attempt^ to understand the 
relative predictive power "of the regressor variables, both 
individually and in combination. . The squalled multiple correlation " 
is broken -up into elements assigned to each- inSiyidual regressor 
and to each possible combination of regressors. The elements have 
the property that the appropriate sums not only add to squared 
multiple correlations with all regres'sors , but aljo^o the' squared 
multiple correlation of^.^ny subset of variables'^lncludlng th^ 
8lmj,le correlations. Commonality analysis may be used as a pro- 
cedure to guide a stepwise- regression. 

Gom.monility analysis does not tell us anything th*t cannot " 
be deduced from a table o'f squarai multiple correlations, ^owevlr, 
commonality analysis 'does T.elp us make comparison^ in an organized 



manner , 



Commonality analysis is not new. Kemp thorne (195^ p . 304ff) 
suggests the procedure briefly. Crea.ger and Valentine (1962) credit 
Bottenberg and Ward (1963) for the same procedure alt-hough with a 
different focus. Newton and Spurrell (1967a, 1967b) arrived at the 



..»e method .nd preset Interpreted examples. The name 
commonality „aa suggested iy »ooi (1971) .ho derived the solution 
independently. A generalisation for sets of variables .as reported 
by.Wlsler (1969) who also showed the relationship between 
commonality analysts and part correlations. Creager (1971a) has 
commented on the procedure and compared' 'it to a factor, analytic 
procedure (1971b,). Mayeske et al (1969. 1973) hav.e used the 
technique extensively. 

.^.Th^ purpose of this paper la to expire the procedure 
further, to develoj, -Ws j,ropertles . and to present a multivariate 
generalization for the explorations of commonall-ty In a situation 

Where there is more than one regressand a 

uc regressand . A new computer-oriented' 

Algorithm Is also presented^. . . 



2.0 Uni variate ConnnQnallty 
... . Univar4«te regression analysis assumes a linear model 

- y - X8 e 

• *■ ■ •. 

-where y is a column^ector with elements y^' (i - 1,2 N) 

representing the observed values of tho . , 

values Of the regressand (al^o called" 

dependent variables or criterion^ y m 

• . -• i-ricerxon;, X i& an N x m matrix with 

e] ements v . M ». i 5 _\ 

iJ o) representing the observed values of 

, the . .egressor '(also called .independent or predictor) variables 
for the N Observations, S is a column vector of m unknown regression 
co,/nciehts. and . is . eolu.n vector with elements .representing 
th, unknown residuals (also c.lled errors). For simplicity, y is 
— .ed to have a zero mean although 'all equ.,ions can be modified 
to allow a non-zero valu.; x is of rank m, the c.. -are assumed 
NID(0,<^2).. . ♦ 

Commonality analysis requires the definition of the regressio, 
equations between y and'iach possible combination of , the m vari- 
ables in X, To_identify these regressions we define a, submodel 
y » X 'S„ + e 

-S^S >s 

wh<.ro t he subscript s replesents in a scend ing . order the n^ indices of 
t!.e.colo,„„. of X contnlnci in the model. We als,o define the com- 
Plemcntury subscript's whilch^ represents tj>e n^ -m-n^ mdlce. in 
asconding orc^er of all colLns of X..ot ^n;cluded in^s. F.or example, 
if X has 6 variables and, s - ^3). th.en f^^ is an N by 2 -matrix 
conlalu^ng tl.o first nnd tl^lrd columns. of x; s - (2456), and X.^ 
i« .-n. N by A matrix cpntalnUng the second, fourth, fifth and sixth 



columns of s may be dropped if it"contains all m subscripts 

— ^ a 

in which case s is the null set. y does hot require /subscript . 

e. is NID(0,a^) where 
«rS s 

c 'e -e'e+ 6 ' ^xlx^ - xlx (x'x ) "^-^X ^'x 0- 

8 S -S»5",.S^S -,8^S ^^S^S' ^sC S !.S*8 

f 

?8*s ^® regression coefficients corresponding to the 

n- variables not included in s and e is the estimate of e computed 
using all v.ariables in the model. 

The statistics usually computed in a regressipii analysis ' 
are estimates of the regression coefficients 

prodlcted values of the regressand, 

8 6 8 * 

thcN^^resldual vector 

y 8 8*^8 * 

the residual variance 

a2 1 A A 

^8 - N-n -1 ^8^8 * 
8 

th^. covariance of 0 



and of the squared- multiple correlation (SMC) 



* 1 A 



The R^^ „ui ordinarily ke.wrltien without the clrcunfUx. 
S±.,Xe (Pearson product-»6„ent) correlations .ay be written as r 
for the correlation of columns and of X 'and .s r for the 
correlation of y with X ^ . ^ ^ ^ 

The estimates, of parimeters for a sUbSet s are not In 
general the sa„e e.tlmates.of the parameters In th* model as those 
ln.whlch>.ll r.gres.prs ire Included. For .x.mple. • . , 

r ^'S. -8-8 -8-B-8»8 . * 

which Indicate. is the^same as 8^ - only if\ . \\ 
K^:: ■ » or 8- ^ . o> that Is, ir X. and X^ are: u^il^rrelated or ' 
the regression coefficients of Xj are .ero, given X . . 



8 



The 



variance of the regressand y may be partitioned 



. J. <'y.- PlOl + 6202 + ...+ H%-2 + 2 ? ? fi oT„ ^ ^2 

. 1-1 i J ij e 

-u "^f estimated 
wher, o^'. are th. /variances of x's. the cT,^^., are ' 

.their covariances, ^nd' „ the unpreaictable variance, 'ihe 

-nance of therefore, can ho hro.en into t.o par/ 



.2 



Where 5. i. the part ofthe variance of , aaaoclate. with an. 
pr-edictnble tro» the Independent variable.. ' 

I 

Newton and Spurrell (l'if,7a\ ai^^ 

Ui67a) discuss two facets of multiple 

resreaslon anal^aU. prediction and operation. Theae two "oaea co.pl 
-t each other alnce an nnderst.n.lns of a proceaa can lead to „ore 
offiCent prediction and prediction ia often the measure of under- 
,.-..-Hns .„f a-proce.a. in both caae. one ..y .i.h to remove ' 
■v.ri„bU. Of Uttle importance from a act of available variablea. - 
Th.s 1., Of courae. one 0, the purpoae, of the anal,aia of vari- 
•nce which ia ao often uaed to teat h.p'othe.e'a that one or more ' 
.»«re»„i„„ c^erricient. are not appreciahl, dlfforent from .er„. 

. i.«....H...,.i» .„...,^,.„t,,<. „„^,^„..^ „;,^^^, ^ 

v«rl„,,iea are of little predictive importance. 

•fit the independent variablea are mutually uncorrelated. then 
».-.n..«rd analyala of variance la ,ulte uaeful, for „e can aee ' 

»^^i<'h, If .my, of the independent varlphio. 

H naenc variables contribute significantly 

.8 . . 



to prediction. If 'the x's are correlated, howeve.r , an orthogonal ana 
of variance requires an ' a priori ordering of. the variables as In 



2.2 2 .2 2. a2 2 ' a2 

O. + 02. 102.1 + 03.1203,12 + ...+ B„ 1, ' ,0^ 

where the B's and o's are partial- regression coefficients and' 

2 2 

variances, respectively; that Is, n - 

' . J..12. . . .12. . . j-1 

represents theregresslon coefficient and variance of variable 1 
with variables 1 through J-1 parttaled out. This procedure Is 
useful If there Is an a priori reason fo~r ordering these tpde- 
pendent variables, but there are ml different ways that the - 
variables may be ordered and different orderlngs will usually affect 
the measured contribution to the predicted sum of squares. The 
problem Is that any variance in, common between two variables is 
ollocale.l «ntlrely to. the former of the two variables' in an ordering; 
any predictive power a third variable has in common with two in an 
earlier position is allocated entirely to the first two, and so 
forth. The ordering, therefore, may Indeed affect our estl-mate of 
the importance of Independent variables. ^. 



The purpose of commonality analysis is to partition a 
. squared multiple correlation into elements associated ,^ith each 
(regr^ssor) variable and. into jelements associated with each 
possible combination 'of iregressors. The analysis shows in some 
sense to what extent each individual variable affects the SMC 

correlation by Itself and how much it affects the SMC in combination 
With other variables. If two variables have no commonality, then 
. ^ .the contribution of either is not affected by the entrance of the 
other variable into the regression equation. If two variables 
. have a .n^n-zero commonality, then the entry of either variable 
into a regression equation will affect the contribution of the ' 
Other, * 

Commonality analysis generates elements such that the sum 
of alJ elements equals the squared multiple correlation. It is also 
qulrtul ih«t the sum of all elemonts associated with a single 
vnrlublo total to the squared simple correlation of that variable • 
. with a regressand, that the sum of all elements associated with 

cither or both of two variables total to the squared multiple _ 
correlation, of those two variables with the regrLsand, and so 
forth. 

- These relationships can be expressed for the two-r egressor 

(m»2) case as ' \ 

%'l2 - "l ^ "2 ^12. ' 

where is the "uniqueness" or "unique" contribution of to the 
SMC, U2 Is the "unique" contribution of and C^^ the common 

eJenient or commonality. The uniquenesses are considered first 

ERIC 10 



order _.o«,i„..utle,,. The contribution o£ alone Is 
2 



^1 - ^1 



and the contribution of alone .is 



"y2 - "2 • 

The relationships, in equations 1^ 2 m^a 1! u ' 

M ux^ns X, and 3 canHe written 

mntrlx form as 

« * 

R GC 

wheire • , ' 
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can then solve equation 5. for 
C - G"^r 



the commonality by 



n which 
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and the explicit solution for C is 

2 ' 2 ■ ' • f 

1 yl2 y2 ^ ^ 1 , 
2 2 - 

2 yl2 yl 

2 2 2 

12 yl y2 yl2 

Uj and Up are In fact sums of aquares and aa auch raust be non 
nrgailvt*.. C,^ may bb either pott 1 tlve > negative-, or rero/ 

The logic for the three-variable case is similar. There 
• 2^-1 possible combinations of variables and, therefore, ^ 
possible SMC's. The definition of the SMC's in ^erins of the/ 
coinroonali t ies are 
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solving for the coraraonall ties we f^jad 



U, 



'12 



13 



'23 



'123', 

■ J 



t) 
0 
0 
0 
0 

-1 

'l 



p 0 

^0 0 

0 0 

0 -1 
■1 0 

0. 0 

1 1 



0 -1^ 
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1 
1 
-1 
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•1 



-1 
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-1 



R 
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R 
R 
R 



1. 

2 
2 

2 
3 

2 

12 
2 

13 
2 

23 
2 
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. useful to organize the element, Into a commonality table such 
as shown in Figure 1 . ^ 

(INSERT FIGURE 1 ABOUT HERE) 

The .ar.ln on- the rig.t-hand side contains the^ vector of cc^on-' ' 

ality coefficients and sums td ' 

f yl2..,in* columns in the body 

Of .he tahle Include the elements, of each repressor and thus these 
columns sum to the squared simple correlations.' 

^ author,, Co.«. .Mayeske ot al,i,69 ) have found the " 

common.,,, ty table more, usefulxwhen j^Oti^. ,,3t Is. when all ' 

elements are divided by the SlJ: Tn 

y tneyMM,. In this case* the element in the 

lower right-hand corties^^Vunltv anH , 

, «j^iBr ut^-lty and the elements add to linity 

iP«tead Of to the SMC. Wi.ed elements can be thought of as 
proportions (percents) of predictable variance instead of pro- 
portions (percents) of total variance. 

The generali;5ation of commonallfv ^« p« 

, ^=0 four or more independent 
vnrJnMc'K is strnlghtf orward Tf '■ • ' 

Rnttorward. If there- are m variables, then wa have 

« • ^ -I c,,u„,l„„, „ ^^^^^^^^ 
•SHC „„ tho sum of all elements common to Its 'regressors . The forma- 
"o„ „olutlon Of such e,uatlons become t.dlous If m' Is large 

but. ccputer algorithms such as the one .presented" In Section 7 
« »-h .„„„,er procedure and avoid the'solutfon of lar„e „et„ of 
edacious. The sl.e of the commonality table m.y also be reduced 
"-ugh definition Of sets Of variables „hl/h are treated as a unit; 
this procedure is discusser 
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Figure r 
3-VariaJble Coamoriality Table 
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Th* partitioning of the SMC then, 



^8 ^ 

s 8 n 



r * 

, .„-,.„^, _ „ ^^^^ ^^^^^^^^ 

=o.reU»o„s «.,„.e th.e varUBU. .s .esiduaU,.. ne par.' 
correlation 



Ldual of 



. is .he, corryatto,. of .1.^ k.^^V^niV, /is the 
Xi.fro, .,.e ^ln-.ar.e,„sa,o„of-X,.„„X, .V wilier ,a7]w^ - 

, or., ., .^^ ^^^^^^^^^ ^^.^^^^^^^ 

oue Of X^.. xhe c,„.o„.iuUa can then he expressed in ter„s of 
these squared part-corr^lattona. • ■ ^ 

«„ce. c„«onaUt, analysis „a. he used .for dec^kng which 
"sres,.„r va.lahles to l,c,ude In a regression equation, u Is a 
P..=.du.H f„r.step„l,e regression anaZ.sls. If the res-earcH al„ 
.l.|.olol, „axl„Uarlon of prediction for a given nu„her of varl- 

.■.,.„, co„.onaU,. analysis Is unneo.essar, since aU posslhle . 

' - , ' 16 • ' 



-SMC. are computed it p*rt of a commonality, analysis . Stepwise 
regression may. proceed as follows: 



.Using Newton and Spurrell .(1967b) Rule 1 which maximizes the 
reduction in residual sum. of squares at" each stage of the re- 
gression by adding, the variable* that reduces the SMC the most, 
we would simply add the variable with the highest sum of co:.monalities 
we would then draw a. vertical line through that column and a hori- 
zontal line through each row which contains a commonality in that 
, columQ. we would then .um the columns again, resulting in new 
totals that would correspond to the covariance of the three re-, 
maining variables with the largest partialed out] After selecting 
a second variable, we would cross out the associate<^ rows and 
columns, -retotal and proceed. Thi, procedure^orresponds to 
adding the variable with the largest partialed correlation. 

Newton, and Spurrell suggest three other rules,. inclMing f (2)' 
selecting the variable with the largest primary (unique) eljent. 
(3) selecting variables in which ^he uniqueness is large coLred 
with any related secondary element, and (4) selecting oinly oil 
variable included in the large positive secondafT^emint . / [ 



/ 
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Slijniricance tents are not known for all commonalities, but the 
uulqueneBS is the contribution o^f ^o the SMC after all ^ 
other regressors are included in the rfgressor equation* < The 
test for a significant lidditional contribution to the SMC is 



,yl2**.m , 



the square root of which is distributed . t with N-m--l degrees 

pf f reedoTQ. This significance tejr is equivalent to testing that 

the partial regression coefficient 6^ • 0. krt insignlf leant 

2 

cr t Indicates that the contribution to Ry2.2 d ^j' con- 
Istent .with the hypothesis that 0. is zero and^ the value U. is 



i 



i 



ue- to sampling error. The' Individual tests oi many partial 

regression coefficients are comaonly^ used although 'the ttsts are 

1 , ' ■ ' . ^ ^ • ' , 
not strictly independent. t ^ , 

I The significance . of the contribution of several or all 

variables to* the SMC may be calculated by summing the unique 

contributions of the several variables and their common elements. 

For example., if m « 4, the test of the contribution of and X. 

would be 



4 



^2 

. N-S 



C*- 
1-SMC 



N-S 
2 



ERIC - 



wher^ C* la the sum of the\ elements that would be excluded^ from 
the swic if the K rogresaors were dropped. This test is equivalent 
to testinr, that all K &**8 yire slmu.l t^ncouoly zero. ' ' 

18 



1 ' • / 

Although there i« no knownUirect test of the significance- 
. of a commonality, we may judge . tl^eir size under ^er^ain circ^m^tances- 
For example, if b f 4 and we .are Interested in t,h,J magnitude of 

Cg^, then we might test the hypotheses- 

. • i ■ . 



«4 \ 



0- 
0 



as shown above. If all thre* hypotheses are accepted^ then 
-^34 ^« "^^^ inconsistent with! a population value of zero. . 

If II3 and are accepted, hut rejected, then we" may conclude 

the is non-z.erp. J f . ■ ^owever ,. ^3 or H^' is^ not accepted, 

then H3^ does not .isolate €3^- and any i^nferences are dubious. 
This procedure can' be used recursively Jfor m'ore complex common- 
alities. . * \ . 

This testing procedure has severe Inferential problems even 
'though examples,where H3 and are acceplted while H3^ are rejected 
are easy to ,^^onstruct . The problem is thlt if the ictual population 
•values of rtJ|e utiiquenesses of-U3 and wele precisely • zero , then 
the value C mit*,*- t.^ - - \ * 



3^ must also be zero, unless X3\and are perfectly 
correlated "in. which case C^^ is indetermina\te-. It is, therefore, 
problematic tp ^ccept zero values for U3 ani U^, then . contfnue . 
to question size of C,,.^ J, 



/ 
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3.0 Numerical; Example . ~ 

, The purpose of this section Is to show what/commonality table looks ■ 

like and to give, so.e hints as^ to hov one ^Ight l^ok at a. table. Computational 
procedures will be discussed In section 7. > . » • 

Figure 3-1 displays all possible 'squared multiple correlations between 
one regressand and four regressors. These five variables were collected on " 
a. sample of eighty students. ' . • 



(INSERT FIGURE 3-1 ABOUT HERE) 
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Figure 3-2 displays a commonality tab;^^ The SMC with all regressors 

entered is .6825 which Indicates that overWof ^h« 

^ wt over oax of the sum of squares of Y can 

bc..,plal„.d by these, four variables. The F statXstlc.for this s„0 ts 40.30 
(ndr...75) „Meh Is^Mghl, sienl«ca„t. The simple squared correlations ra„se 
ir.^ .my to .63=1 and are lndmd„,ll, highly sl,nlHoant when s„„eeted £o 
U,c „,.din.,r, test ior the sisniacance of a correlation. We concl,.do. therefore. 



20 
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Figure 3-1 ' 

Squared Multip^JLe Correlations (r) 
for all combinations of 4 predictors 
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I- 0."i967 . "I 

Z 0*A6<i3 '2 

"3 0.53 7« i2 

^\ • 0.5269 3 

5 0.6080 13 

6 0.5783 • 23 

7 0.6245 X23 

8 0.6351 4 

9 0.668^ 14 

10 0.6'tA3 24 

11 0,6707 124 

12 0.6528 34 

13 0.6H21 134 
0.6571 234 

15 ' 0.6826 JL234 



4^ 



that there is some predictable varianb^worth looking at 



anbiijj 



• ■ (INSERT FIGURE 3-2 ABOUT HERE)- 
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Figure 3-2. 



FOUR VARIABLE P^DBLfH 

rwe DEPPNOENT VARIABLE IS 

SET AC^DMYM 

FIRST ORDER 
U*(X) 

SECOND ORDER 

: 12 . 

: n . ' . 

c i4 
C 23 

: 14 

THIRD ^ ORDER 
C 123 

: 124 

Z 114 
C 234 

FOURTH ORDER' 
C 12M 



SET I 
0.0255 



0.0038 
0.0009 
0.0207 



0.0030 
6.03U 
0.0264 



0.2853 

R 2 ( X ) (.yqtiarod simp Jo correlation)^-'* 

R? ( TUT )(squared multiple 
. . correlaCcton ) 

f»CNT 



0.6826. 

j 

0.0374 



75 



/(0.30 



2.45 
.34 

1.68 
3.70 



SET 2 

0.0005 

0,0038 



O.OOIB 
6.0160 



0.0030 
0.0311 

0.1228 



0.^853 
0.4643 
0.6H2 6 
0-.0007 



SET 3 SET 4 



O.0119 0.05BI 




0.0030 



0.0264 
0.1228 



0.2853 
0.5259 
0.6826 
0.0174 



0.0207 

0.0160 
0.0747 



0.0311 
0.0264 
0.1228 



0.2853 
0.5.351 
0.692^ 
0.0352 
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There are no negative commonalities in this example. Negative 
commonalities arc possible but not common in educat li^onal data. A 
negative commonality indicates that one variable actually confounds 
the predictive power of .another, A hypothetical example may ex- . 
plain this phenomenon. BotTi^weight* and speed are important to, 
success as a*prof essional football player and each would be 
moderately correlated with a measure of success in football. Weigh 
and speed are presumably negatively correlated and would have a 
negative commonal'l t.y in 'predicting success* in football* If both 
. weight' andL speetj are known, one would expect to make . a. much better 
predixftion of success using both variables to select fast, heavy 
m'e^ rather than Just selecting the fastest regardless of WeUght or 
heaviest regardJLesd^ pf ■ speed . Thus the negative commonality in-, 
dicates that explanatory ' power of either - is great er when the other • 
is also used. 

The uniquenesses are shown at the top of t;he. figure 3-2 and 
the t statistics at the bottom. The uniquenesses indicate the 
amount of variance explained by each variable after all other 
variables are entered into the equation. X^^ and X'^ have signifi- 
cant large uniquenesses and t statistics. X2 does not look worth 
keeping, and X^ could be a sampling fluctuation and seems to add 
little. 

Since one and perhaps two variables add little, we ask where 
the original predictive power of these variables went. The common-^ I 
ality C^234 indicates that 28% of. the explained sum of squares is 
common to the four variables, that is, entering any one of the four 
variables into the equation .will increase the SMC by at least .28. 
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Clearly, much of^the Explanatory power of these four variables 
is redundant . 

The commonality 023^ is fairly large indicating thaf'the 
use of any of .the.e- variables will explain some of the same 
predictable variance as the others. The next largest value is 

which shows the common element of and . 
. ^ To summarize, the table seems to indicate that X2.X3, and 
predict much the same- part of the explainable sum of squares, 
m fact, the predictive power of X2 is almost completely common 
to the others. since X^ is most powerful and X^ is most different 
•^rom X^. we may expect that the SMC R^^^ is quite large". 
Figure 3-1 shows us that this SMC Is .6684 or Just .0142 less 
than the. SMC with all four variables. 
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Commonality is^a complex tneasure so it may be instructive to look 
carefully at the simple case of two regressor variables. 

Thd squared multiple correlation can be expressed as a function of 
three simple correlations by' » 



i^'-i+r«-2r r r 

'""12 

and the commonality written as 



12 yl y2 '^y 12 



The commonality is, therefore, a contrast! between what " the SMC would have 
been if and^X^ were uncorrected (i.e. r^^ + r:^ and what the actual 
SMC is (i.e. R^^p. Substituting (1) into (2), we have 

'Vyfn - '^yi'^i^ - Wn 

^12 - 

If .rj2 - 0, then the SMC is th^*- of the squares of the two staple 
correlaUon, coefficients and thus the co»,onallty is ..ero and the unt,ueneas 

of U is then R^, and of U Is ^ j 

1 ana 01 is R^^- " ^oes not equal zero, then the 

SMC may be larger or smaller than /~5 T~ j 

J5 sm^xxer than /^2_^ ^ ^2^ , depending on the sign of the 

product r^^r^^r^^ and the magnitude of r^^. 

"rUo complexity of the relationship between 'r^^' ^12' ^'n ^^-n 
graphically in Kigure 4-1. For this graph, r^^ and r^ are considered fixed 
constants. .3 and .2, respectively. Given particular values of r^/and r 

cannot in general range over the entire area between >1 and J^since 
extremely high or extremely low values would result in a non-positive deflnlt. 
corr.eL-,tlon matrix. The boundaries for permissible r 



^12 



are 



r„,r_ - V 



Which for this exa,ple gives the boundary -.8747 < r^^ 1 9947 . " 

Figure 4-1 graphs the values of R?' .nd r p .i 

, . ^12 '"'^ ^12 ^"nc«??.n8<|>f r., over 

per»,.,iue „„ge. .U negative values of r^^ are aasociaL „"h " 
negative C,^ and very high positive values also have negaelv. co^dnaAtles. 
The value o, C,^ is still s^n „ Its • 
»,uare. multiple correlation Is af lts .m^. e,, . -i,,,,,, 

mirror Image, of the RJ . 

This graph brings out the Important point that' the co™„nallty may 
, aleo^ be associate,! with high positive values o£ r . 

'rn. relationship of X,, X,, '.nd . are sho™ graphically aj In Plgure .-a 
Tfio vcctors._X, and X^ are of-unlt length and represent variables X, and' 
X3; the vector V represents the projection of the (unit length) vector Y on 

'12- The length of the vector OY Is the multiple correlation R^^^. 

The distance of Av la ii^/^ ^, " 

Ay Is U2 and the distance is u^^^ 

.vec.tor Oi Is the s,uare root of .K^^ . .^ '^ Z.., Is- „hlt i would 
be If was orthogonal to X^ while OA(r^p and OB(r ) rtmalned 
. constant. (oc would be .ero.) Jlnce the commonality Is the 

- squared of OY minus the square of OY, 0^ > d Implies a negative ■ 
commonality. 

"sure 4-3 shows the effect o, r^^ on the multiple correlation ' 
a.nd commonality over the range of permissible values while holding 
'yl ',2 "-Sta-nt. First, the terminus of. any vector rep^e-' 

•sentlnn the multiple correlation must fall on the line h'v' since • 
^ it» projection-^. X^ must be orthogonal and of length OA. 'rhe 
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SB^lest possible angle (or largest cosine) of XjOX^ Is represented 
by Xj^OX^A, since a vector perpendicular to OXj must meet the 
vector perpendicular to OX^^ vlthin the unit circle. The largest 
possible angle Is X^^OXJ for the same reason. The actual vector 



Xj must lie between X^ and X^'. 



The dotted lines from the origin to y+ and y- Represent the 
two vectors where the coooohallty would fee zero since the multiple 



correlation would be /~2 ~~2 

r ,+r 



or ^ 2 2 
OA^+OB^ 



If and Xg are 



yl y2 

correlated highly enough, then th'e vector representing the multiple 

correlation will terminate between y- and y' in which case the 

multip:ie correlation is larger than / 2 . 2 and the commonality 

yl y2 

is negative. Also, if X^^ and X2 are correlated lowly enough, then 
the terminus of the multiple correlation vector would fall between 
y+ and y" in which case the commonality would be negative. If the 
vector representing the multiple correlation terminates between 

" A 

y+ and y- , then the vector is shorter ,than /^2 ^^2 and the 
commonality is positive. 



28 



• Iliese graph. sh„„ that the co-ion.l|!ty 61 two varla61« 
U „ot a vector but the difference between Vhe ' squares of two ' 
vectors an^ thus should not be considered a .arlance m itself. 
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5*0 St it B of Viirlablea 

Commonality tables become unmanageably large i^or even a* 

_ fairly ^modest number of regre^so^re. For example; i\ there ane 

" • - \ 

•^10 regressors the number of. lines in the table is 1,.Q24'. . It is- 

•-, . ■ ' 

therefore important to reduce the table in size. \ 

One. method is- to group the " regressors into loglcalUy 
similar, mutually exclusive sets ^ndJerform the commoni^^ity analysiV 
on the sets. The SKC's used for the com'monality analysis,' are the 
SMC.'s,f;or all' possible combinations of sets of variables, not of • 
Individual regressors. . • i» " . 

The commonality\able computed. .in this manner Is a summary 
of the elements of si c^monality analy'sis of the individual r\- 
grc«8or8. ConiJidering ^he example in section 3, the^'four variables 
may be grouped into two sets, set A containing x. and x,,-and si B 
containing X3 and x^ . The^.commonality and uniquenesses of the 



sets are 
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* "a * ''as- 



The ..■ominality ^ble is shown in Figure 5. . . 

. ».e a2«orlthn,-rt„„ in section 7 Is also appropriate for -sets using 
, the SMCs Of all possible sets of variables as Input. . 

• ■ Oo.onaUty analysis «ith sets of variables «y retire »/rlx inver 
.ion.with a large nu^er of variables. s«e of these variable/^ be 
highly correlated with the result that the analysis is subJeZ to- 
^sslblo nuMorical InstablUty. »e user should be oa;ef/to «e sure 
the correlations uMong the independent variables are not extremely high 
»-crical experiments by Beaton, Kufilf and Barone (1^., have sho™ that 
very high colUnearlty viu affect regression coefficients substantially, 
hut do; not affect s«aredWple correlations too seriouyOy.. Double 
precision is p^obabl, sufficient to avoid MOst-proble^ of this sort. 

f 
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A B 

u» ■ .0298 .0298 



°AB •^'^^ .5080' .5080 
■ " .5578 .6527 -6825 

Figure 5. Conimonalitj) table foy sets 
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' Croag.r and Boruoh (1969) suggest a combination of factor 
anajysis and regression analysis as an alternative to comonality 
analysis! Using the notation of this paper, they argue that 'the ' 
jnatrix X may be factored as 



ZF 



where Z.is an orthogonal Nxf matrix of factor scores and F is " 
an fxm matrix of factor loadings. Using maximum likelihood 
techniques (see Joreskog, 1967). one can estimate the matrix F 
such that 



F'Z'ZF, « R - / 

- - XX -/ j=l 



A f < 

"^'^''^./xjc. ^« general an apj/roxlmation to the correlations 
among the regressors, and th^f model becomes .(if the • ' 
r^grepsors were of unit variarfbe) 



y - ZP6 + e 



6 is estimated* by regression analysis.. Since Z'Z - I, the 
predictable variance is simply the sum of squares of the 

Clements 'in the vector Ffi . 



If one can hypothesize an underlying factor structure. • , 
■then the Creager and Boruch tnethpd is the natural way to Identify 
the contributions of thq factors, and the method pay be useful 
for exploration of, found commonalities, but commonality analysis 
differs In that It simply locates elements of the SMC In the 
given variables without postulating underlying, orthogonal variables. 
It would seem that the two methods complement . each other and may 
be used together, commonality analysis perhaps helping develop 
the factor hypothesis. 
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6.0 Multi variate ncnimongUty 

MultivM-Uto comnonallty is a technique for a3ses.i„g the co-on and 
unique predictability Of several regressors or sets of regressors on a set 

Of S,>1 "S'-^sanas.' toe technique is a si.plegeneraU.ation of univari- 
ate^cf-onallty and the results of the two vlll be. the saae if the value of 
• p is unity. Multivariate co-o„ality is to multivariate analysis very ™ch 
as^univariate comonallty is to regression analysis. 

\ o„e Simple Method of assessing the co»o„allties of several repressors 
on a ?et of regressands would be to compute a eon«onallty table for each 
rcgresUd, then su. the several co«onallty tables into a single Bultivari- 
ate tadlc. Although this might be appropriate for some problems, this ' 
.proce4ur^ might overweight the co-onality if two or «ore of the regr;ssa„ds 
were very highly correj^ted with each other and slMlarly correlated with 
the regressors. A high co«onallty for one of the regressands would also 
Show UP in the co«onaUty tables of its correlates with the result that 
the ^Itivoriato co«»onallty in the summary table would 'be very large or, • 
m a sense, counted twice or more. B,is procedure also varies from eo„non 
practice in multivariate analysis. ' \ 

An alternative procedure that avoids redundanj predictive p'ower trans- 
form= the regressands such that a new set, of regressands are computed which 
Lave the property that each has a unit variance and is uncorrelated with the 
other transformed regressands. B.e transformed variables contain aU of the reZ 
»for,„ation in the original regressands and can be transformed back to the 
original if needed. Since the transformed regressands are uncorrelated, the 
,.re<U,aio„ or on,, is not associated with the prediction o£^or/^ 
mul«v,.r.,ate c««nality proposed here con be th^ght ^ perZ/ming a 
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trantformtion to imlt orthogonal regresso^s, then a univariate oo»onality 
«na)y,i, on ea.h tran.ror,^d regressand, and su»ing the univariate eo-onal- ' 
tty Int., iiiiiJUvnriia.- (•«i.r£n/.J H,.v tiibl.j. • 

There are mny ways to transrom the regr'iissands to unit orthogonal 
orientation. One way is to perform a principal emponants anaiysis of the 
regressancs, conpute eonponent scores, and then rescalo the component scores 
for unit variance. Alternatively, .a Cholesiy .transforation of the regressands 
can be. perfonned, and residual scores with ui.it orthogonal orientation con- 
puted...-B,ls proeedWe is equivalent to computing a Oram-Schmld decompoatlon 
of-the regressands with the result that the first regressand is simply 
resealed, the second is tatan as a, residual from the first, the third as a 
r..sl...„U rrom t,,., rir.-a a,,,. „.co„a, and so forth. Since the Gram-=el„dd ' 
«U,od is .computationam- simpler and the co^onaUty tables„uiider either 
procodur^ are Identical, the Ora»Wd method is used here. 

The actual calculation of oultivariaibe comtonaUtles is only ,^ry 

sUghtly more complicated and expensive than univariate. co«,nality. The 
transformed regressands do not need to be computed for each member of the 
sampl.,. A correlation matrix including boih the (untransformed) regressands ' 
and U,e ro«rc..s6rs is computed, a^e . correlation matrix of the regros.,ands 
can be transformed using the MSOE operator which also transforms the correla- 
tions Of the regressors and the regressands. The calcuUition of all possible ' 
regressions of the regressors on aU of the .transformed regressands can be " 
computed using the saiHo' number of SWFS as in the univariate, case. (For a 
complete discussion of the MSIB and SWP operatdrs, see Beaton (19* ). ) Ihe , 
SWP operator computes the set of terms of the fo« 1 . „2 where the R= 
are t..c. squurod Multiple correlations which must he su».ed. B,is su. is called 
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^ yaa. trace of the explaihed cross-products matrix. The traces for all combina- 
tions of predictors mayV converted to maltivariate commonalities' by the 
Baronc algorithm discussed] in the next section^ 

Multivariate commonality is related to multivar>a<^e hypothesis testing 
.in a manner analogous to the relationship of univariate commonality to 
regular leHting. If the Beaton operators are used, the matrix of sums of ' 
squares and cross-products of the residuals is computed after each regressi 
•This matrix is called • where the subscript s represents the particular' 
regression th^was removed. The trace of is the unexplained sum of 
sqviares and. thus p minus trace (E^) is the explained sum of squares! 
The matrix has, the^property that its latent roots are 

1 - a2 „he,e A is the canonical correlation between the re- 
gressors In s and all. regressands. The determinant of is 
Wilks- K Which can b^e used" for testing the hypothesis tha't there " " 
Is no predictive power in^the regressors in s . ' 

Pach of thXmultivariate uniquenesses can be tested for ' 
Significance. To test a particular uniqueness, one computes the 
E3 for that uniqueness, i.e., sweeps all other regressors • 
(or sets Of regressors), and 'comput^ the matrix E, the residual 
after all repressors are swept. Wilks' statistic is 

A . det (E) .. , : . 



dot (K ) 
s 



n,. A s'tatistlc .„.te used to test the hypothesis that the 
P^rt.ou-Ur ».,ltlvarlste „„l,„e„ess Is zero whloh Is e,ulvalent to 
tOHtlug that the resressdr(», add nothing to the oanonloal 
correlations, ^ 
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l*e-t^rac-ea from vhich the multivariate commonalities are compuied are 
not W»u...d l>y ...vo H.d unity .u. ufo U.e Bquarod multiple corroiationn. Tf 
the re«rcn«and3 are completely predictable, then the trace would bo p , the 
number of r^^ressands.- However, the traces associated with particular 
rogressors or combinations of repressors may have upper bounds substantially 
less than 5 . in fact, the maximum^trace for a single repressor is G^ityf 
^e maximum tra'pe for a set of repressors is the number of repressors tj 
number of , rcpre^sando, vhichever is smaller. Since the same traces cannot 
be larpo, the coLonaUties may seem disappointingly small. Each commonality 
should be judged in comparison to its maximum. 



\ 
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7.,0 -Analysis of Variance 

eommonality analysis can be a useful adjunct to noti- 
orthogonal nnalyses of variance and covariance. The analysis 
•of vnriance/:is a. procedure to partition the total sum of squares 
of a "dependent" variable into parts associated with one or* more 
"independent" variables or factors f,or the purpose of estimating 
mean squares and testing hypotheses. We consider here only 
situations in which there are at least two factors. If the ex- 
perimental design is balanced, then the partitioning of the sum 
of squarjs is straightforward and the part associated with each 
. factor is distinct, thus the sum of the parts associated with 
each factot plus the error sum of squares add to the total sum 
of squares. A balanced or orthogonal analysis, ' therefore, does 
break up the whole into its parts. If the' design Is^on-or thogonai; 
i.e., not balanced, then parts of the tot^sum of squares can be 
attributed' to more than one factor with the\esult that the total ' 
sum of squares is not broken up into distinci parts. associated with 
fnctars or'thoir interaction. ' \ 

There are a number of ways in which non-orthogonal analyses 
can be performed. One way is to order the factors a priori and 
asslBO. the common pnrt of the sum of squares to the first factor 
in the« ordering, thereby assuring the allocation of all squares 
to some factorortoerror. 

♦ 

■ Another procedure is to treat each factor or interaction . 
separately so that all other factors are fitted befo.re any hypothe'sis 
is tested. This procedure is equivalent to treating each hypotUesin 
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test as a test of the-il-gnlficancf of rcgressidn^coefflclcnta. Con- 
' M±ii€rp the model 

. - M^: y - XI + e 
where the matrix X contain, dunjmy variables corresponding to row, 
column, and Interaction effects and the vector^S is partitioned 
accordingly,. UslnR the notation fro« the previous sections, let 
he the subset of dqmmy vorlables representing a set of effects • 
•.(e,..g. the row effects). The test of the significance of the 
corresponding parameters 3^ is formed by specifying the hypoth'esls- . 



R : 6 « t) 
s 



and^ thef alternate model 



M„ : " X~3 - + c 

^ - -S 8 • 



a»cc. t„pU« i. ^^^^^^^ ^^^ ^^ ^ ^^^^ 

• SS(3^) . y»Xy<X;x^)-lx;y - y'xa'X)'^X> * 
and the appropriate P statistic is . 

M, es(e; )/n„ 
^N-n " ^ 



(y'y-y'X<X'X)"^X'y)/(N-n) 



Koch «ct Of effects can be tested using this procedure although the " 
t«HLs a,-« not ntrlctly independent as U also the casrvlth ortho«on«3 
deHl«n«. It is convenient to collect the sums of squares, degrees " 
of rr.odom.^mean squares, ind F statistics in ah analysis of variance 
tabic. .However, the sums -o'f ,qu«,es allocated to various factors ' 
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plus the error sum of squares do not add up to the total, thus 
the whole is not completely divided into its parts. 

-The analysis of variance can also be approached through 
commonality analysis. The total sum of squares caji be ^partitioned 
into par ts* attributable to each set of effects and each combination 
of .sets of effectSt These common and unique elements added to 
the error sum of s^quares add to the total sum of squares. The 
tests 0^ the uniquenesses are equivalent to the tests of the sets 
of effects shown above. l^owever, since there arc ^o hypothesis 
tests available for commori*^elements , part of the motivation for 
partitioning variance is lost. 

Commonality analysis, therefore, gives new information for , . 
non-orthogonal analysis of variance since one can investigate the 
sums of squares that either did not enter into any hypothesis test 
or were entered into more than once.< . 
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8.0 Algorithms 

Votntnonul Ity mialynin rcquireo two coznputatidnal steps: first, 
computing all possible GMC*o and, then' ccnnputlng the commonality elements. 
tUiis section discusses the two phfises and presents a complete FORTRAN sub- 
routine^ 

A vector all possible SMC can be computed using the algorithm 
of Shat7.off (1968). Ghatzoff uses the sweep (SWP) operator {See Beaton 

(196^0 or Dcmpulor (1963)* wliich adds and deletes vnriublea to a multiple 

' • Figure 

regression equation. The SMC's must be computed in the order shown in/' 

The Shatzoff algorithm has the property that each of t hggg "^ -1 sweeps 

computes a different SMC* The, subprogram present^d below modifies the 

method by replenishing ifie matrix occasionally in order to avoid buildup 

of computational error, » • 

Although commonality elements can be computed by first forming, then 

• solving 'Simultaneous equations, 'an algorithm due to Darone is simpler for 

hand c(ilculation and requires far less computer memory, ' The a3.gorithm 

rcquuTj; (irr inpuU the GMC*«. An additional dummy fjMC of value '/cro as 

the zeroth element is also needed. 

Each element in an m -variable commonality table may be represented 

*■ 

as. C where s is the subscript containing n' < m integers in 

^ . s — 

numorlnal order and representing tHe indices of the variables included . 

in.' C . I'he complementary subscript i contains the n-=m-n indices 
^ s s 

not -included in. s. If all m indices are included in , s , then i 
is. considered to contain no indices. 

Tlie Parone al(^oriiihm begins the commonality computation of any 
t'}i:uu*ul by rorjiiinrj^fui eqnaiJon vJilJ tho firHl, <-l(imcnt us mxmv.i 
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Fir,. 7.1. Co^mnonality equations. 
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R - I that is, the SMC with complementary subscript tod negative sign.. 

PJaoh index in s; .is then appended one at a time' to those already in s 

to Wivm a net of luiVjnrrJpU) n* ; o(u:h HMC with one of the subncripto 

In a* is added to the eqixation. The integers in s are then appended to 

s two at a time to form subscripts 5' , and the corresponding SMC 

are subtracted from the equation. This process continues with more and 

more indices in s appended s and with the sign of the addition 

changinf^ at each step until all n indices in s are used, 
« s 

For example, let us find the equation for C^^ ^ analysis with 
four variables (jn = ii) . The complement of the subscript s = 13 
is s = 2U , thus the first element is 

2 

Append in/^, the olcmcnti; of s one at a time to s , the subscripts in~ 
, 8* = (l2'i|23l*) and, thus the next elements added to C^^ ^® 

2 2 

Finally, appending; the elenjents of s two at a time, we have s' * = 
and tliun next clomont subtracted from C.^ is 

^yi23i4 • 

'Jlie equation for C^^ is then 

13 • . ^ , 

2 ? 2 2 ' 

^13 " "''y2)i Sl'A "y23»i ' "y123)< * 

I'br another exfimple, C^g^)^ ^ complementary su"bscript 0 , 

' thur, the rirr.t, element R- is subLractod 

. \ 

-0 , 
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then the Values selected, by pairs of integers are subtracted, 

» ^ 

2 2 2 2 2 2 
"^12 '^3 "^iU '•^23 '•\2l* "^31* » 

and the 3 index\eoinbinations added 

' 2 2 2 2 

* ^123 * ^121* •'^yi3l* * ^23k » 

niul, finnlly, the RMC \^th, all subscripts is subtracted, - ' 



L23l* * 



The commcaiality elefiient i) 



^1231* 



T,2 2 -.2 
"yiV "^23 ""^24 "^31* 




- 4 * 5^3 * ^4l2 -43 



' " 423'-^ ^21* * 43U.-4231* • 

The equations for all commonalities f or \m = 1* are shown in Figure' 
•J'JKf . Lori, hand column jonttitns the cojrnnonomy element for a four 
vardnWa .problem and the riRht hand. columns contai\the squared multiple 
correlations and their relative location in 4 compute\proferam. The main 
body of Llie- figure contains the "matrix G which may be\ed in the equation 

JO 

S = Gr 
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to compute the* commonalities from the vector of SMC's, The matrix G 
wm$ romput(?(l u«inK tlio Baronc lajjorithm not by mt^trix invemion, but 
mny vhackiul by r<»nnlnK u matrix (f^ (lorinJnK thf rclallonohli) of 
the c and SMC in a matrix, then multiplyirig GG*''' which muist 
result in an identity matrix. 

The readei' may verify the matrix G and the commonality table in 
Figure 3.2 by multiplying G by the vector £ in Figure 4*^-1. 

A comput^x^ubroutine for computing comraoncLLities is shown in 
Figure Y.2. The jiubroutine accepts as input a c3*oss-products of corre- 
lation matria^computcs^all possible SMC, and^ then a commonality table. 
Rcvcra] rer,res8and^v^nd sets of regressors may be used. The jprogram 
doen not compute multi variutb^-^wamxnimftlitj^ 

'Jlio ctniipuier prc)fj;ram uoca the binary naCu^ of cpmputers to advantage 
The presence or absence of ft subscript is coded by\a zero or one bit in 



the appropriate position Off a memory register* The binary word is 
evaluated as the location in SMC table of the appropriate element. For 
example, the .complement of C^^ os 

comp (Cg,^) ^ OlOlg = L0C(5) ^ R^^g . 

*l7ic variables position are read from right to left, thus 0101^ indicates 
the- j-rrur.onro of variables X^^ and . 

*J'Ih» cull in/', r.f(iurn(:(j tani <U*V\r\\\A(m oJ' parahictcrrj ii; shown In 
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CALLING' SKQJJENCE - " ; ,\ . . * 

-CAM. COMMON. (C,MPI,LC,NC,Ll!,»H,IK,NK,!I!ia'L,LDlND,Ili»,HACR) 

vMrnii'muv, ■ . . 

. ■ ■ . ^ ■ . ^ . . - 

'C (M1M.MI*I) • • ' : ' 1NP,UT CKOGS-PHOIHJGTS MATHIX ' . * 

MPI ! DIMENSION OF C ' 

^"^^ J iNteR Vector containing the row^(column) 

NUMBERS OF THE CONCOMITANT VARIABLES. 

J NUMBia^ OF CONCOMITANT ..VARIABLES DEFINED IN 
•LCi. 

^^^""^ ' INTEGER VECTOR CONTAINING THE ROW (COLUMN) 

NUMBERS OF THE INDEPENDENT .VARIABLES. 

. _v '^ffi NUMBfeR' OF "independent VARIABLES DEFINED 

' IN 'LIll., . 

^^"^^ • 5 INTEGER VECTOR CONTAINING THE NUMBER OF 

' . INI)i'n>I.»II)I.:NT VAHTABIJOfj TO BE nROUP]?D PROM THE • 

'LIl' ],Jf5'l' '10 I'XJUM EAClf OI-' HIK NK »OE'I?jr UHED 
IN ami COMMON AI^ITY ANALYSIS. TIHS SUM OF THE 
ELEM13NTS IN THIS VECTOR MUST EQUAL NH. 

: NUMBER OP SETS TO BE FORMED USING THE 'IK' 
LIST. 

# 

: ANY 'BCD' HEADING Of' LESS THAN 120 CHARACTERS. 
THIS WILL BE PRINTED- PRECEEDING EACH COMMON- ' 
ABILITY TABLE. 

/ : INTEGER VECTOR CONTAINING THE ROW (COI.UMN) 

NUMBERS OF THE DEPENDENT VARIABLES A 
SEPARAIE COMMONALITY TABLE WILL BE COMPUl'ED 
FOR EACH DEPENDENT VARIABLE. 

: NUMBER OF DEPENDENT VARIABLES 

• - • • ^ 

""^'■^'^'^^ ' '^'"1- VIWJOH MUfJT CONTAIN 'IHI'; AIJ'HANUMUIOTC 

J -^'l™ OlMiACH iJJTOnWNT VARIAllLE. TJIE T.TTLKB 

Muryr correspond to the variauler defjni'Jd' in 

THE 'LD' LIST OF DEPENDENT VARIABLES. 
Flfi. 7.2. JJniviu'iote conuwonulity program. 



NK 

TITL 

J.D 



ND 



SO 



HACK (NK) . : TIITS VKCTOR MUST COH'J'AIN 11IK ALl'JIANUMHKH I C 

'i'i'i'J4-;j! OK mew UK 'ihk 'nk' /iKri jwinkd hy 

• . 'IHK 'Ml', 'JK' I.Ui'l'i). . 

CAWJ-ID .H0UT1N}«) 
SWPSra.NEWPG 

EXAMPLE" 

^ GIVEN: 'C IS A 10 X 10 CROSS PRODUCTS MATRIX. 

OHERE ARE 2 DEPENDENT VARIABLES LOCATED IN POSITIONS 
l and 2 IN TIIE MATRIX. 
, • THERE ARE 8 INDEPENDENT VARIABLES LOCATED IN POSITIONS 

: 3 thru 9. 

POSITION 10 CONTAINS THE VARIABLES CORRESPONDING TO 
• TOE OVERALL MEAN. 

IN THIS EXAMPLE' WE WANT TO ACCOMPLISH THE PILLOWING FOR EACH 
OF THIS 2 DEPENDENT VARIABLES 

1) AUTURT -niE GROSr; PRODUCTS MATRIX BY REMOVING llUi ' 
GRAND MEAN 

2) FORM 3 'SETS' PROM THE INDEPENDENT VARIABLES. TJIE 
FIRST SET CONSISTING OF VARIABLES (3, 1» and 6). 

THE SECOND SET OF VARIABLES (5, 7) AND THE THIRD SET 
OF VARIABLES (6, 8, 9). 

3) PERli-ORM A COMMONALITY ANALYSIS USING THESE 3 ' 
SETS OP INDEPENDENT VARIABLES. 

TOE FOLLOWING FORTRAN STATEMENTS WILL ACCOMPLISH THE REQUIRED 
ANALYSIS. 

DIMENSION C(aO,10),LH(8),LC(l),IK(3),LD(2),HDS(2),HACR(3 

DATA M/3, 1»,6, 5, 7,6,8,9/ ',NH/8/ 

, DATA IK/ 3, ?, 3, / ,NK/3/ 

DATA ■ I.(:/,1.0/,NC/I/ 

DATA ].l)/l ,J'/,NI)/;V 

DATA IIJ).'J/(;j||)Kf., l/,ni)KT. ;r/ 

DATA llACh/6lh'3ET f ,6llGET 2 , 6HSET 3'/ 

CALL COMMON(C,IO,LC,NC,LH,NH,JK:,NK,12H ANY HEADING, LD,ND,HDS, 




Y.P (CuntM). Univariftio commonality proynun-. 
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